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Project  Summary 

Our  goal  in  this  effort  is  to  automatically  detect  deception  by  an  individual  or  expert  who 
is  contributing  to  an  information  knowledge-base  consisting  of  multiple  experts. 
Contemporary  decision  makers  often  must  choose  a  course  of  action  using  knowledge 
from  several  sources.  Knowledge  may  be  provided  from  many  diverse  sources  including 
electronic  sources  such  as  knowledge-based  diagnostic  or  decision  support  systems, 
through  data  mining  techniques,  and  so  forth.  As  a  decision  maker’s  sources  become 
more  numerous,  detecting  deceptive  information  from  these  sources  becomes  vital  to 
making  a  correct,  or  at  least  more  informed,  decision.  This  applies  to  unintentional 
misinformation  as  well  as  intentional  disinformation.  We  are  developing  formal 
definitions  for  a  deception  attempt,  the  deception  core,  effective  deception  and  successful 
deception.  A  deception  attempt  occurs  when  the  opinions  returned  to  a  decision  maker  by 
an  expert  agent  are  not  those  calculated  by  that  expert  agent  with  the  given  observations 
but  are  substituted  to  influence  the  decision  maker’s  actions.  The  deception  core  refers  to 
those  opinions  which  are  manipulated  to  form  a  deception  attempt.  An  effective 
deception  is  a  deception  attempt  which  succeeds  in  altering  the  actions  of  the  decision 
maker,  though  not  necessarily  to  the  actions  desired  by  the  deceptive  expert.  Finally,  a 
successful  deception  is  an  effective  deception  in  which  the  alternate  actions  which  the 
decision  maker  chooses  are  those  desired  by  the  deceptive  expert.  Our  ongoing  research 
focuses  on  employing  models  of  deception  and  deception  detection  from  the  fields  of 
psychology,  cognitive  science  and  artificial  intelligence  as  well  as  implementing 
deception  detection  algorithms  in  probabilistic,  intelligent,  multi-agent  systems 

Major  Accomplishments  FY  05 

•  We  expanded  our  framework  to  explore  deception  detection  in  all-source 
intelligence  analysis  processes. 

•  We  developed  a  new  algorithm  and  theoretical  framework  that  supports 
sensitivity  analysis  and  validation  of  Bayesian  knowledge-bases  central  to 
deception  detection. 
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Intelligence  Analysis,”  Proceedings  of  the  2005  International  Conference  on  Intelligence 
Analysis,  McClean,  VA,  2005. 
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Objective: 

The  goal  of  the  research  is  to  automatically  detect  deception  by  an  individual  or  expert  who  is  contributing  to  an 
information  knowledge-base  consisting  of  multiple  experts. 

Approach: 

The  approach  includes  the  following: 

1)  Extend  and  analyze  Bayesian  knowledge-bases  for  capturing  multi-expert  information  under  uncertainty 

2)  Develop  framework  for  categorizing  and  classifying  errors  hat  may  be  committed  by  an  expert 

3)  Design  algorithms  for  automatic  deception  detection  cpable  of  providing  detailed  evidential  information  in  support  of 

said  deception  plus  analysis  of  the  impact  of  the  deception 

4)  Evaluate  the  effectiveness  of  this  approachby  developing  a  prototype  system 


Progress: 

Year:  2004  Month:  07 

ANNUAL  REPORT  FOR:  F49620-03-1-0014 

Project  Summary 

With  the  increased  acceptance  of  knowledge-based  intelligent  systems  for  diagnosis  and  decision  support,  the 
dependence  of  human  decision  makers  upon  such  systems  has  increased  as  well.  As  we  become  more  dependent  upon 
these  systems  the  impact  of  deceptive  information  offered  by  these  systems  becomes  impossible  to  ignore.  Our  goal  in 
this  proposal  is  to  automatically  detect  deception  from  a  given  expert  source  with  a  longer  term  goal  to  address  the  even 
more  difficult  problem  of  deception  detection  in  the  face  of  multiple  expert  collusion. 

Major  Accomplishments  FY  03 

We  have  developed  an  initial  model  of  deception  which  not  only  attempts  to  detect  deception  but  identifies  the  deception 
tactic  as  well  as  the  goal  of  the  deception  The  first  step  in  this  model  of  deception  detection  is  the  detection  of  unexpected 
results/anomalies  or  detenmntng  whether  some  piece  of  information  is  suspect. 
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Progress: 

Year:  2004  Month:  10 

ANNUAL  REPORT  FOR:  F49620-03-1-0014 

Our  goal  in  this  effort  is  to  automatically  detect  deception  by  all  individual  or  expert  who  is  contributing  to  an  information 
knowledge-base  consisting  of  multiple  experts.  Contemporary  decision  makers  often  must  choose  a  course  of  action 
using  knowledge  from  several  sources.  Knowledge  may  be  provided  from  many  diverse  sources  including  electronic 
sources  such  as  knowledge-based  diagnostic  or  decision  support  systems,  though  data  mining  techniques,  and  so  forth. 
As  a  decision  maker's  sources  become  more  numerous,  detecting  deceptive  information  from  these  sources  becomes 
vital  to  making  a  correct,  or  at  least  more  informed,  decision.  This  applies  to  unintentional  misinformation  as  well  as 
intentional  disinformation.  We  are  developing  formal  definitions  for  a  deception  attempt,  the  deception  core,  effective 
deception  and  successful  deception.  A  deception  attempt  occurs  when  the  opinions  returned  to  a  decision  maker  by  an 
expert  agent  are  not  those  calculated  by  that  expert  agent  with  the  given  observations  but  are  substituted  to  influence  the 
decision  maker's  actions.  The  deception  core  refers  to  those  opinions  which  are  manipulated  to  form  a  deception  attempt. 
An  effective  deception  is  a  deception  attempt  which  succeeds  in  altering  the  actions  of  the  decision  maker,  though  not 
necessarily  to  the  actions  desired  by  the  deceptive  expert.  Finally,  a  successful  deception  is  an  effective  deception  in 
which  the  alternate  actions  which  the  decision  maker  chooses  are  those  desired  by  the  deceptive  expert.  Our  ongoing 
research  focuses  on  employing  models  of  deception  and  deception  detection  from  the  fields  of  psychology,  cognitive 
science  and  artificial  intelligence  as  well  as  implementing  deception  detection  algorithms  in  probabilistic,  intelligent,  multi¬ 
agent  systems. 


Year:  2005  Month:  09  Final 

Final  Report  for:  F49620-03-1-0014 

Our  goal  in  this  effort  is  to  automatically  detect  deception  by  an  individual  or  expert  who  is  contributing  to  an  information 
knowledge-base  consisting  of  multiple  experts.  Contemporary  decision  makers  often  must  choose  a  course  of  action 
using  knowledge  from  several  sources.  Knowledge  may  be  provided  from  many  diverse  sources  including  electronic 
sources  such  as  knowledge-based  diagnostic  or  decision  support  systems,  through  data  mining  teclmiques,  and  so  forth. 
As  a  decision  maker's  sources  become  more  numerous,  detecting  deceptive  information  from  these  sources  becomes 
vital  to  making  a  correct,  or  at  least  more  informed,  decision.  This  applies  to  unintentional  misinformation  as  well  as 
intentional  disinfonnation.  We  are  developing  formal  definitions  for  a  deception  attempt,  the  deception  core,  effective 
deception  and  successful  deception.  A  deception  attempt  occurs  when  the  opinions  returned  to  a  decision  maker  by  an 
expert  agent  are  not  those  calculated  by  that  expert  agent  with  the  given  observations  but  are  substituted  to  influence  the 
decision  maker's  actions.  The  deception  core  refers  to  those  opinions  which  are  manipulated  to  form  a  deception  attempt. 
An  effective  deception  is  a  deception  attempt  which  succeeds  in  altering  the  actions  of  the  decision  maker,  though  not 
necessarily  to  the  actions  desired  by  the  deceptive  expert.  Finally,  a  successful  deception  is  an  effective  deception  in 
which  the  alternate  actions  which  the  decision  maker  chooses  are  those  desired  by  the  deceptive  expert.  Our  ongoing 
research  focuses  on  employing  models  of  deception  and  deception  detection  from  the  fields  of  psychology,  cognitive 
science  and  artificial  intelligence  as  well  as  implementing  deception  detection  algorithms  in  probabilistic,  intelligent,  multi¬ 
agent  systems 


